All Questions
3 questions
12votes
3answers
49kviews
How do I set/get heap size for Spark (via Python notebook)
I'm using Spark (1.5.1) from an IPython notebook on a macbook pro. After installing Spark and Anaconda, I start IPython from a terminal by executing: ...
- 303
12votes
3answers
6kviews
Issue with IPython/Jupyter on Spark (Unrecognized alias)
I am working on setting up a set of VMs to experiment with Spark before I spend go out and spend money on building up a cluster with some hardware. Quick note: I am an academic with a background in ...
- 121
9votes
3answers
9kviews
How to run a pyspark application in windows 8 command prompt
I have a python script written with Spark Context and I want to run it. I tried to integrate IPython with Spark, but I could not do that. So, I tried to set the spark path [ Installation folder/bin ] ...
- 1,065
